Iterative Learning without Reinforcement or Reward for Multijoint Movements: A Revisit of Bernstein's DOF Problem on Dexterity
نویسندگان
چکیده
A robot designed to mimic a human becomes kinematically redundant and its total degrees of freedom becomes larger than the number of physical variables required for describing a given task. Kinematic redundancy may contribute to enhancement of dexterity and versatility but it incurs a problem of ill-posedness of inverse kinematics from the task space to the joint space. This ill-posedness was originally found by Bernstein, who tried to unveil the secret of the central nervous system and how nicely it coordinates a skeletomotor system with many DOFs interacting in complex ways. In the history of robotics research, such illposedness has not yet been resolved directly but circumvented by introducing an artificial performance index and determining uniquely an inverse kinematics solution by minimization. This paper tackles such Bernstein’s problem and proposes a new method for resolving the ill-posedness in a natural way without invoking any artificial index. First, given a curve on a horizontal plane for a redundant robot arm whose endpoint is imposed to trace the curve, the existence of a unique ideal joint trajectory is proved. Second, such a uniquely determined motion can be acquired eventually as a joint control signal through iterative learning without reinforcement or reward.
منابع مشابه
A Challenge to Bernstein's Degrees-of-Freedom Problem in Both Cases of Human and Robotic Multi-Joint Movements
This paper aims at challenging Bernstein’s problem called the “Degrees-of-Freedom problem”, which is known to remain unsolved from both the physiological and robotics viewpoints. More than a half century ago A.N. Bernstein observed and claimed that “dexterity” resident in human limb motion emerges from accumulated involvement of multi-joint movements in surplus DOF. It is also said in robotics ...
متن کاملNatural Resolution of Ill-Posed Inverse Kinematics for Redundant Robots: A Challenge to Bernstein's Degrees-of-Freedom Problem
This paper aims at challenging Bernstein’s problem called the “Degrees-of-Freedom problem”, which is known to remain unsolved from both the physiological and the robotics viewpoints. More than a half century ago A.N. Bernstein observed and claimed that “dexterity” resident in human limb motion emerges from involvement of multi-joint movements with surplus DOF. It is also said in robotics that r...
متن کاملDynamic Obstacle Avoidance by Distributed Algorithm based on Reinforcement Learning (RESEARCH NOTE)
In this paper we focus on the application of reinforcement learning to obstacle avoidance in dynamic Environments in wireless sensor networks. A distributed algorithm based on reinforcement learning is developed for sensor networks to guide mobile robot through the dynamic obstacles. The sensor network models the danger of the area under coverage as obstacles, and has the property of adoption o...
متن کاملLearning movement sequences with a delayed reward signal in a hierarchical model of motor function
A key problem in reinforcement learning is how an animal is able to learn a sequence of movements when the reward signal only occurs at the end of the sequence. We describe how a hierarchical dynamical model of motor function is able to solve the problem of delayed reward in learning movement sequences using associative (Hebbian) learning. At the lowest level, the motor system encodes simple mo...
متن کاملTwo Steps Reinforcement Learning in Continuous Reinforcement Learning Tasks
Two steps reinforcement learning is a technique that combines an iterative refinement of a Q function estimator that can be used to obtains a state space discretization with classical reinforcement learning algorithms like Q-learning or Sarsa. However, the method requires a discrete reward function that permits learning an approximation of the Q function using classification algorithms. However...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید
ثبت ناماگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید
ورودعنوان ژورنال:
- J. Robotics
دوره 2010 شماره
صفحات -
تاریخ انتشار 2010